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Abstract 



, Under certain assumptions in terms of information and models, equilibria correspond to possible stable 

■ outcomes in conflicting or cooperative scenarios where rational entities interact. For wireless engineers, it is of 



paramount importance to be able to predict and even ensure such states at which the network will effectively 
operate. In this article, we provide non-exhaustive methodologies for characterizing equilibria in wireless games 
in terms of existence, uniqueness, selection, and efficiency. 

I. Introduction 

The major works by Von Neumann, Morgenstern and Nash are recognized as real catalyzers for the theory 
of games which originates from the works by Waldegrave (1713), Cournot (1838), Darwin (1871), Edgeworth 
J> : (1881), Zermelo (1913), Borel (1921) and Ville (1938). Whereas the strong developments of game theory and 
^ ■ information theory occured approximatively at the same time of history, namely in the middle of the 20th century 
5t , with the major works by Von Neumann, Morgenstern, Nash, and Shannon, it is only recently that deepened 
analyses have been conducted, at a significant scale, to apply game theory to communications problems. During 
the fifty years following the seminal work by Shannon there were only a small number of papers adopting 
a game-theoretic view of communication problems. To cite a few of them we have lUl where point-to-point 
communications are seen as a game between the channel encoder (choosing the best input distribution in terms 
of mutual information -MI-) and channel (choosing the worse transition probability in terms of MI), Q where 
source coding is seen as a game between the source encoder and switcher (modifying the source distribution) 
having antagonistic objectives in terms of distorsion, Q where the author exploits game theory for the joint 
signal-and-detector design using game-theoretic techniques to perform multi-parameter optimization, or also lH 
where a legal encoder-decoder pair fights against a jammer. By contrast, many papers exploiting game theory 
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for communications and especially wireless communications have been released over the past fifteen years (||5l, 
|[6l . fTl . m, in, etc.) and the phenomenon seems to gain more and more momentum. There are many reasons 
for this craze for game theory in the wireless community, here we will give a few technical reasons for this. 
Note that, in this article, we will focus on technical problems arising at the physical and medium access layers 
of a wireless network and not on economic aspects related to it, like the auction problem for spectrum, even 
though it is also an important scenario where game theory is used. 

An important reason for this surge of interest in game theory in the area of wireless communications is the 
determinant role of certain major wireless actors Uke spectrum regulators. Here is an example illustrating this 
role: by allowing anybody to use some portions of the radio spectrum, which are referred to as unlicensed 
bands, spectrum regulators have naturally created a game. Wireless devices (or groups of devices) using these 
bands interact with each other by exploiting the available spectral resources. An other scenario of paramount 
importance where game theory is naturally the dominant paradigm to analyze interactions between devices 
consists of networks of terminals equipped with a cognitive radio. Indeed, as spectrum congestion has become 
a more and more critical issue, the Federal Communications Commission has released an important report ifTOl 
providing a legal framework for deploying such networks. Another factor for the great interest of the wireless 
community in game theory is that considering a terminal as an intelligent entity capable of observing and reacting 
sufficiently rapidly has become a more and more realistic assumption with the significant progresses of signal 
processing (e.g., spectrum sensing algorithms and dramatic increase of admissible computational complexity). 
Also, for a long time, wireless networks were based on the single-user channel paradigm introduced by Shannon 
but networks have evolved and multi-user channel models are now considered as a key element for increasing 
reliability, rates and security of wireless communications. In such networks, terminals share common resources 
like energy, power, routes, space, spectrum, time, etc, which implies potential interaction between them and game 
theory is, by definition, the branch of mathematics studying interaction between intelligent entities. Roughly 
speaking, the born of multiuser networks appears to be a milestone delineating two eras: the era were game 
theory was used to analyze or interpret communication systems and the era where it is used to design or 
construct communication system. 

When inspecting the works applying game theory to wireless networks, there is generally a quite significant 
part of them dedicated to analyzing the issues related to the notion of equilibrium. This is not surprising since 
this concept is instrumental for wireless engineers. For instance, the existence of an equilibrium can allow them 
to predict the effective operating state(s) of the network. Most often, the type of equilibrium studied is the Nash 
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equilibrium (NE) (see e.g., the recent papers in ifTTI ). which corresponds to the minimum condition of stability 
for an equilibrium (i.e., it is robust to a single deviation). Whereas there are many papers where issues, such 
as existence and uniqueness of an equilibrium in a given wireless game, are well treated, there is no paper 
attempting to provide a complete methodology in order to analyze equilibria in wireless games. It is therefore 
difficult to have a complete picture of the existing theorems and techniques available to analyze these equilibria. 
One of the purposes of this article is precisely to contribute to building this picture by giving methodologies 
for studying equilibria in non-cooperative wireless games. One of the main goals of this article is to answer 
typical questions such as: Does the network have a pure NE (Sec. HID )? If yes, is it unique (Sec. ITVT )? If it does 
not exist, what can be done? On the other hand, if there are several equilibria, how to select one of them (Sec. 
rvl)? If the selected equilibrium is found to be inefficient in a given sense of efficiency measure, how can the 
game be modified to improve its efficiency (Sec. IVIb? This article will be structured (Sec. HIll - IVll ) according to 
this list of questions. These sections will be preceded by a section introducing the notion of equilibrium (Sec. 
mi ) and followed by a section showing to what extent the provided methodologies can be applied to other types 
of equilibrium (Sec. IVIII ). Throughout the article, more emphasis will be made on the methodology rather than 
attempting to enumerate all the main results available. For each main issue addressed (e.g., existence) some 
useful definitions, theorems and techniques will be provided and concisely illustrated by a typical wireless game 
at the physical or medium access layer. 

II. The concept of equilibrium 

In this article, we will mainly focus on a certain type of games namely static strategic (form) non-cooperative 
games with complete information (SNG) and finite number of players. Strategic or normal form games consist 
of a triplet Q = (/C, {5j}igyC) {^ijiex:) where /C = {1,...,K} is a finite set of players, Vi S /C, Si is the 
set of strategies of player i and Ui his utility (payoff) function; concerning the notations we will often use 
s = {si,...,sk) to refer to a vector and S = Yij^i^i to refer to the Cartesian product of sets. The games 
are non-cooperative in the sense that each player/user wants to selfishly maximize his own utility Ui over his 
strategy set Si. The assumption of complete information means that every player knows the triplet Q. Further, 
they are implicitly assumed to be rational in the sense of Savage lITll i.e., each player does what is best for 
him and rationality of the players is assumed to be common knowledge. Even though we restrict our attention 
to SNGs, the methodology provided here can be, to a large extent, applied to other types of games, which will 
be discussed in Sec. IVIII Also, most of our attention will be dedicated to pure-strategy Nash equilibria (pure 
NE), which correspond to the minimum condition of stabiUty that is, the NE strategy profiles are stable to a 
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single deviation. Indeed, a pure NE is defined as follows: 

Definition 1 (NE): The vector s* is a (pure) NE for Gif^i^ /C, Vs- € Si, Ui{s*,s*_i) > u^{s^,s*_^) where 
we use the notation s_ j to refer to the strategy profile of all players except for player i. 
An NE is therefore stable to a single deviation. In some contexts, for example, in the context of population 
(large number of players), a stronger condition of stability can be required. This is the case of evolutionary 
stable equilibria, which are stable to the deviation of a fraction of a population |[T3l . In the core of this article 
only pure, mixed and correlated equilibria will be mentioned. Indeed, one has to distinguish between pure, 
mixed, and correlated strategies. As already seen, for a player, choosing a pure strategy consists in picking one 
element in his set of possible actions. Implementing a mixed strategy consists in associating a probability with 
each of the possible actions and run the series of actions generated by the corresponding lottery. For example, 
a transmitter can decide to transmit at full power or not at all, by following the realizations of a Bemouilli 
random variable. A mixed Nash equilibrium is therefore a vector of probability distributions verifying the Nash 
property in Def. 1 where Sj represents a distribution, denoted by q^, and ui has to be replaced with the expected 
utility for player i: Ui{q^, ...^q^^) = Y^ses Pi^)^ii^) where p{s) = UjeK^ji^j) ^"'i Ui^j) ^he probability 
with which player j chooses the action Sj G Sj . In contrast with mixed equilibria, in correlated equilibria |[T4l 
the lotteries used by the players can be correlated (by coordination signals) that is, in general, we do not have 

III. Existence 

Mathematically speaking, proving the existence of an equilibrium amounts to proving the existence of a 
solution to a fixed-point problem |[T5l ; this is why so much effort is made to derive fixed-point theorems (see 
e.g., lfT6l . ifTTl ) by game theorists. Therefore, it will not be surprising to see that equilibrium existence theorems 
are based on topological properties of the strategy sets of the players and topological and geometrical properties 
of their utility. This explains why the respective works by Lefschetz |[T8l . Hopf |[T9l . Brouwer 1201 and Kakutani 
II2TI on fixed-point theorems (FPT) have had an important impact in game theory. To prove the existence of 
an equilibrium at a problem at hand, one may always attempt to derive an FPT, which is the most general 
method. However, there are many scenarios assuming usual channel models and performance metrics, and for 
which existing theorems are sufficient. For example. Shannon transmission rates or rate regions have desirable 
convexity properties that are needed in standard known theorems for equilibrium existence. The purpose of this 
section is to provide certain of these useful existence theorems and mention some examples where they have 
been applied in the literature of wireless communications. 
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A very useful existence theorem is a theorem stated in |[22l . resulting from the contributions of |[23l . |[24l . and 
|[25l . The corresponding theorem, which will call the Debreu-Fan-Glicksberg theorem as in |[22ll . can be applied 
if the users' utilities are quasi-concave and some other properties are verified. Before stating the corresponding 
theorem, let us review the definition of a quasi-concave function: a function ijj is quasi-concave on a convex 
set S if, for all a G M, the upper contour set Ua = {x ^ S, f{x) > a} is convex. We will use the acronym 
QG to refer to games in which utilities are quasi-concave. 

Theorem 2 (Debreu-Fan-Glicksberg 1952): Let Q be an SNG. IfVi^ IC: Si is a compact and convex set; 
Ui(s) is a continuous function in the profile of strategies s and quasi-concave in Si; then the game Q has at 
least one pure NE. 

A special case of this theorem is when the utility functions are concave. In this respect. Theorem 1 by Rosen 
|[26l for concave i^— person games can be seen as a corollary of Theorem |2l Furthermore, if the utility functions 
are assumed to be affine functions, Nash existence theorem |[T5l of a mixed equilibrium in finite games (FG; 
|/C| < +00, \Si\ < +oo) can also be seen as a special case of Theorem|2] This is due to the fact that the mixed 
strategy of player i G /C, i.e., the distribution qi used by player i, belongs to a compact and convex set [0, 1] 
and his (averaged) utility is an affine function of qi. 

Example 3: For the distributed energy-efficient power control (PC) problem introduced in Q is defined 
as follows. The strategy of user i £ )C is his instantaneous transmit power pi € [0, p.™^^] and his utility is 
^i(p) = "^^^^^'"^ where f : M"*" [0, 1] is a sigmoidal efficiency function (e.g., the packet success rate) and 
SINRj is the signal-to-interference plus noise ratio for user i. This game can be shown to be quasi-concave 
and thus has at least one pure NE. 

Of course, there is no reason why utilities used in wireless games should always be quasi-concave. For instance, 
in the case of the energy-efficient PC game we have mentioned, the quasi-concavity property is lost when the 
utiUty is modified into Ui{p) = Ui{p) + api, which corresponds to implementing a linear pricing technique 
|[27l . If a game can be shown to be non quasi-concave, it still can have some nice properties that ensure the 
existence of a pure NE. This is precisely the case if one has to deal with an S-modular game (SMG) 1281 . |[29l 
or a potential game (PG) ll30l . S-modular games include submodular games OTI and supermodular games ll28l . 
|[29l . In what follows we give the definition, an existence theorem and an example of game for these types of 
games. 

Definition 4 (S-modular games): The strategic game Q is said to be supermodular (resp. submodular) if: 
Vz G /C, Si is a compact subset of M; Ui is upper semi-continuous in s; Vi G /C,Vs_j > s'_^ the quantity 
Ui{s) — Ui{si,s'_^) is non-decreasing (resp. non-increasing) in Sj. 
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Furthermore if the utiUties of the game are twice differentiable there is a simple characterization of SMGs. 
Definition 5 (Characterization of S-modular games): If'\/i(zlC,Ui is twice differentiable, then the game Q 
is submodular (resp. supermodular) if and only if 

V(i,j) G/C2,i/i,^^ <0 (resp. > 0). (1) 

An interpretation of a super-modular (resp. sub-modular) game is that if the other players —i increase (resp. 
decrease) their strategy, player i has interest in increasing (resp. decreasing) his. One of the nice properties of 
SMGs is that they do not require convexity, concavity assumptions on the utilities to ensure the existence of an 
NE. The following theorem for SMGs can be found in IIBTI and follows from Tarski fixed-point theorem |[32l . 
Theorem 6 (Topkis 1979): If Q is an SMG, then it has at least one pure NE. 

An example of supermodular games can be found in ll27l where the authors uses a linear pricing technique 
to improve the energy-efficiency of the NE of the distributed PC game. The corresponding utiUties are Vi € 
/C, Ui{p) = Ui{p) + api which are not quasi-concave, as already mentioned. An example of submodular games 
can be found in |[33l and |[34l . 

Now we turn our attention to an other important type of games: potential games. This type of games has 
been introduced by Monderer and Shapley in |[30l . 

Definition 7 (Potential games): Tiie game Q is an exact (resp. ordinal) potential game if there exists a function 
(j) such that \/i € /C,Vs = (si,s_j) € 5, Vs. € Si, Ui(s) — Ui(s[,s_^) = 4>{s) — 4>{s'i,s_j) (resp. Ui{s) — 
Ui{s'i,s^i) > ^ (t){s) - (A(sU-i) > Oj. 

It is important to note that the potential function is independent of the user index: for every player, (j) allows 
one to quantify the impact of a unilateral deviation on all the users' utilities in exact PGs while it gives the 
sign of the difference of utilities in ordinal PGs. Like SMGs we have the following existence theorem. 

Theorem 8 (Monderer-Shapley-1 1996): If Q is a PG with a finite number of players, compact strategy sets, 
and continuous utilities, then it has at least one pure NE. 

Example 9: In / |35|/ the authors formulate a constrained PC problem as a game where each user wants to: 
minimize his transmit power pi S [0, PP^^] subject to the constraint /j(SINRj) > 7^. Considering, without loss 
of generality Ui{p) = \og{pi) for the users's cost functions, it can be checked that 4){p) = X^^^i log(pj) is a 
potential function for this game. 

We see that Theorem [8] is very useful if a potential function can be found. If such a function cannot be easily 
found, other results can be used to check if the game is potential. As mentioned in |[30l . a very simple case 
where it is to easy to verify if the game is potential is the case where the strategy sets are intervals of M. In 
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this case we have the following theorem. 

Theorem 10 (Monderer-Shapley-2 1996): Let Q be a game in which the strategy sets are intervals of real 
numbers. Assume the utilities are twice continuously differentiable. Then Q is a potential game if and only if 



It is interesting to notice that in the (non-exhaustive) list of theorems stated so far, none of them requires to 
explicit the best responses of the players: the best response (BR) of player i £ JC corresponds, by definition, 
to the set of strategies BRj(s_j) maximizing the utility of user i when the rest of the world plays s_{. 
BRj(s_j) = argmaxnj(sj, s_j). In general BRj can be a correspondence but it is a function in many wireless 

Si 

games addressed in the current literature of communications. If the BRs can be explicated, the existence proof 
boils down to proving that the BRs have a non-empty intersection, which can be very simple in some scenarios. 
For instance in the power allocation (PA) game of |[36l where the authors study interference relay channels, the 
best response of the users are piecewise affine functions in the case of their amplify-and-forward protocol. The 
existence issue and even uniqueness issue are quite simple to analyze in such a case. To conclude this section, 
we summarize the methodology presented in Fig. [T] In the box "Not in this article" one could for instance, 
put the recent work on distributed power control ||37l where the authors show that instead of proving an FPT 
(mathematically), the powerful model checking concept can be used to verify (with a computer but rigorously) 
the existence of a certain network properties or a winning strategy. 

IV. Uniqueness 

Once one is ensured that an equilibrium exists, a natural question is to know whether it is unique. This is 
important not only for predicting the state of the network but also crucial for convergence issues. Unfortunately, 
there are not so many general results on the equilibrium uniqueness. In this section, for sake of clarity, we will 
distinguish between two types of situations, depending whether the BR of every player can be explicated or 
not. 



A. The BRs do not need to be explicated 

A natural question would be to ask whether the Debreu-Fan-Glicksberg theorem has a counterpart for 
uniqueness, that is, there exists a general uniqueness theorem for quasi-concave K— player games. To the 
best of the author's knowledge, the answer is no. However, there is a powerful tool for proving the uniqueness 
of a pure NE when the players' utilities are concave: this tool is the uniqueness theorem derived by Rosen |[26l . 
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This theorem states that if a certain condition, called diagonally strict concavity (DSC), is met, then uniqueness 
is guaranteed. This theorem is as follows. 

Theorem 11 (Rosen 1965): Assume that Mi G IC: Si is a compact and convex set; Ui{s) is a continuous 
function in s S and concave in Sj. Let r = (ri, ...,r/<) be an arbitrary vector of fixed positive parameters. 



then the game Q has a unique NE. 

To illustrate this theorem we provide an example of wireless game where it has been applied successfully. 

Example 12: In l[38]l the authors generalized the water-filling game of / |?9|/ to fast fading multiple access 
channels (MACs with one base station -BS- and K mobile stations -MS-) with multiple antennas both at the 
transmitters and receiver (uplink case). In this game, each user wants to maximize his ergodic transmission 
rate by choosing the best precoding strategy. While showing that this game is concave is quite easy, proving 
its uniqueness is less trivial. It turns out that the DSC of Rosen has a matrix counterpart here and can be 
proved to be true. Proving the DSC boils down to proving that: Tr (MN + PQ) > where M = A — B, 
N = B~i - A-^ P = C-D, Q = (B + D)~i - (A + C)"\ and A, B, C, D are positive matrices. 

B. When the BRs can be explicated 

If the BR of every player can be expressed, it is possible to analyze their properties and for some classes of 
functions (or correspondences) to characterize the number of intersection points between them. A nice class of 
BRs is the class of standard BRs. Standard functions have been introduced by Yates in 1401 ; they are defined 
as follows. 

Definition 13 (Standard functions): A vector function g:Rf -^R^ is said to be standard if it has the two 
following properties: 

• Monotonicity: V(x,^') G M^^, x < x' ^ g{x) < g{x'); 

• Scalability: \fa > 1, Vx G M^, g{ax) < ag{x). 

In HOl it is shown that if a function is standard then it has a unique fixed-point. Applying this result to the 
best responses of a game we have the following result. 

Theorem 14 (Yates 1995): Assume that the best responses of the strategic-form game Q are standard. Then, 
the game has a unique NE. 
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A simple wireless game where the BRs have these properties is the energy-efficient PC game introduced by jSl . 
which we have already mentioned. The BRs can be shown to be (see e.g., ll27l . BTI ): V G {1, K}, BRj(p) = 



reception noise variance. It can be checked that the BRs are monotonic and scalable. 

As mentioned in the end of Sec. Hill if the BRs are available and quite simple to exploit, it might be possible 
to find their intersection points. The number of intersection points corresponds to the number of equilibria. A 
well-known game where this kind of approaches is very simple is the Cournot duopoly 11421 for which the BRs 
of the two players are affine and intersect in a single point. A counterpart of the Cournot duopoly in wireless 
networks is treated, for instance, in B3l . 



In fact, there are important scenarios where the NE is not unique. This typically happens in routing games 
B4l . P31 and coordination games B6l . Another important scenario, where such a problem arises, corresponds 
to games where the choice of actions from different players is not independent, for instance non-cooperative 
games with correlated constraints and generalized NE pTl is one of the solution concepts. A central feature 
in these constrained games is that they often possess a large number of equilibria. Natural questions that arise 
concern the selection of an appropriate equilibrium. What can be done when one has to deal with a game having 
multiple equilibria? Are they some dominant equilibria? Are there some equilibria fairer and more stable than 
others? Obviously, the selection rule is strongly related to the used fairness criteria. As equilibrium selection 
is a theory in itself BSl . the authors will give here a very incomplete view of the general problem and only 
partial answers to these questions. In fact, we will mention only three issues related to the equilibrium selection 
problem: how to select an equilibrium in concave games; the role of the game dynamics in the selection; the 
role of efficiency in the selection. These issues have been chosen here because they are strongly connected to 
the content of the other sections of this article. 

In the case of concave games, here again, Rosen |[26l gives a very neat way to tackle the problem. In ll26l . 
the author introduced the notion of normalized equilibria, which gives a way of selecting an equilibrium. 

Definition 15 (Normalized equilibrium): Let Q be a concave SNG, r a vector of positive parameters, C = 
{s G S, h{s) > 0} is a constraint set. An equilibrium s* of this game is said to be a normalized NE associated 
with r if there exists a constant A such that Xi = where Xi are the multipliers corresponding to the Kuhn- 
Tucker conditions Aj/i(s) = 0. 

This concept has been recently applied by P9l to study decentralized MACs with constraints. The impact of 




where /3* is a constant, hi the instantaneous channel gain of user i and o"^ the 



V. Equilibrium selection 
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these constraints is to correlate the players' actions. As mentioned in the beginning of this section, there can be 
multiple NE in this type of games. This is precisely what happens in decentralized MACs. One of the problems 
that arises in such contexts is to know how a player values the fact that constraints of another player are satisfied 
or violated. Some extreme cases are: (i) A player is indifferent to satisfaction of constraints of other players; 
(ii) Common constraints: if a constraint is violated for one player then it is violated for all players. The concept 
of normalized equilibrium, applicable to concave games, is precisely a possible way of predicting the outcome 
of such a game and/or selecting one of the possible equilibria. Specifically, the authors of P9l have shown that, 
in their context of multiple access game with multiuser detection, the normalized equilibrium achieves maxmin 
fairness and is also proportionally fair (for these notions see e.g., ifSQl). 

So far, we have always assumed static games with complete information namely the game is played in one 
shot, based on the fact that every player knows everything about the game. This is in this precise framework 
that existence and uniqueness of an NE has been discussed. Interestingly, the Nash equilibria predicted in such 
framework can be observed in others that are less restrictive in terms of information assumptions. These other 
frameworks include the situation where each player observes the actions played by the others, react to them by 
playing his BR, the others update their strategy accordingly, and so on. It turns out that these games can converge 
to an NE that would be obtained if the players were knowing the game completely and playing in one shot. Fig. |2] 
shows the possible NE in the PA game of |[36l in two-band two-user interference relay channels. In this figure 9i 
represents the power fraction user i allocates to a frequency band, l — 6i being the fraction allocated to the other 
band. It can be checked that the sequence {9'f^;9'Ll = BR_i((9f 6*^^ ^ = BRj ) ; (9^^^ = BR_i ((9f ...} 
will converge to one of the three possible NE, depending on the game starting point i.e., on the value of 
i G {1,2} and the value of 9^ G [0,1]. As a more general conclusion, we see that the initial operating 
state of a network can determine the equilibrium state in decentralized networks having certain convergence 
properties. We cannot expand on this issue here but it is important to know that games with standard BRs, PGs, 
and SMGs have attractive convergence properties. For example, the authors of lISTI have shown how simple 
learning procedures, based on mild information assumptions, converge to the NE predicted in the associated 
game with complete information. 

More generally, if there is a certain hierarchy in the game, this hierarchy can be exploited by one or several 
players to enforce a given equilibrium. The desired equilibrium can be selected because of its efficiency. 
Therefore, equilibrium efficiency is also a way of selecting an equilibrium. The fact that this equilibrium will 
effectively occur depends on whether there exists an entity capable of influencing the game. In the scenario 
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of B3l where two point-to-point communications compete with each other (interference channel), the network 
owner chooses the best location for the added relay in order to maximize the network sum-rate at the equilibrium. 

VI. Efficiency 

We have seen that a simple scenario where game theory is a natural paradigm is the case of decentralized 
wireless networks. A well-studied problem is the PC problem in the uplink of MACs. One of the motivations 
for decentralized PC in such a context is to decrease the amount of signaling sent by the BS for PC. But 
there is a priori no reason why a decentralized network of partially or totally autonomous and selfish terminals 
should perform as well as its centralized counterpart, for which the PC problem can be optimized jointly at 
the BS. This poses the problem of efficiency of the network. More specifically, for a decentralized network 
having a unique NE, it is important to characterize the equilibrium efficiency since it is the state at which the 
network will spontaneously operate. As mentioned above, if there are multiple equilibria, equilibrium efficiency 
can be used as a discriminant factor to select one of them. Whatever the equilibrium be unique or resulting of 
a selection, two critical issues arise: how to measure the network equilibrium efficiency (Sec. I VI- Al l : how to 
improve its efficiency (Sec. IVI-BI ) when the overall network performance at the equilibrium is found to be not 
satisfying. 

A. Measuring equilibrium efficiency 

A well-known way of characterizing efficiency of an equilibrium is to know whether it is Pareto-optimal 
(PO). Pareto-optimality is defined as follows. 

Definition 16 (Pareto-optimality): A profile of strategies s^^ is said to be PO if there is a non-empty subset 
of players /C++ such that 

yi e /C++, Vs G S, Ui{s^^) > Ui{s), (4) 

and 

yi G /C//C++, Vs G 5, > Ui{s). (5) 

Said otherwise, s^*-* is Pareto-optimal if there exists no other profile of strategies for which one or more players 
can improve their utility without reducing the utilities of the others. A simple example of Pareto-optimal profile 
of strategies is as follows. 

Example 17: Assume a canonical 2— user MAC / I52I/ / I53I/ . Y = Xi + X2 + Z with a receiver implementing 
successive interference cancellation (SIC). Consider the very simple game where, knowing the decoding order 
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used by the receiver, the users want to maximize their Shannon transmission rate Ui{p) = log2 (1 + SINRj) 
by choosing the best value for their transmit power pi G [0, P™^^]. It can be checked that all the profiles of 
strategies corresponding to the full cooperation segment of the capacity region frontier are Pareto-optimal. In 
fact, along this segment, we even have a zero-sum game Vj> € [0, Pf^^] x [0, P™'^^], ui{p) + U2{p) = Psum. 

1 H — - — ^2-^ — 1 is the MAC sum-rate. 
In the example we have considered to illustrate Pareto-optimality we see that PO profiles of strategies are such 
that the sum of the utilities is maximized. This observation corresponds to the following general result (see 
e.g., Il54l ): every strategy profile s which maximizes the weighted sum Xjigc '^*^*(— ) Pareto-optimal, with 
Qj > 0. This result is useful to determine PO profiles of a game. In particular, the results holds when ai = 1. 
The corresponding function corresponds to a very well-known quantity: the social welfare. The social welfare 
of a game is defined as follows ||55| : 

Definition 18 (Social welfare): The social welfare of a game is defined as the sum of the utilities of all 
players: 

K 

w = '^Ui. (6) 

Social welfare, which corresponds to the average utility of the players (up to a scaling factor), is a well- 
known absolute measure of efficiency of a society, especially in economics. Is this quantity relevant in wireless 
communications? In theory, and more specifically in terms of ultimate performance limits of a network (Shannon 
theory), social welfare coincides with the network sum-rate. In contrast with many studies in economics, we 
have in communications, thanks to Shannon theory, a fundamental limit for the social welfare. For example, if 
we have K terminals, each of them implementing a selfish PC algorithm to optimize his Shannon transmission 
rate, communicating with two BSs connected with each other, we know that w cannot exceed the transmission 
rate of the equivalent virtual K x2 multiple input multiple output (MIMO) system. In practice, it can be a good 
measure if the players undergo quite similar propagation conditions, in which case, the utilities after averaging 
(e.g., over fading gains) can be close. If the users experience markedly different propagation conditions the use 
of social welfare can be sometimes arguable and even leads to very unfair solutions. We can mention at least 
three reasons why social welfare has to be replaced, in some scenarios, with other measures of global network 
performance. First, it is an absolute measure and therefore does not translate how large the gap between the 
performance of the decentralized network and its centralized counterpart is. Second, as mentioned, it can be 
unfair. Third, while it has a very nice physical interpretation when the users' utilities are chosen to be Shannon 
transmission rates, its meaning is much less clear in contexts where other utilities are considered (e.g., energy- 
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efficiency). Before providing a way of dealing with the first drawback mentioned, let us illustrate the second 
and third ones by the example of energy-efficient PC games. 

Example 19: In / |47T/ the authors have studied, in particular, a non-cooperative energy-efficient PC game 
(see Ex. \3\for more details)} when the BS implements SIC. When the BS can optimize the decoding order 
associated with SIC, the authors have shown that after optimization of w = Xli^i ''^i — ^iLi ^^^^p.^'\ the 
users who were "rich" in terms of link quality are now even "richer". This shows that w can be an unfair 
measure of energy-efficiency of the network. On other hand, the other performance metric considered in 114 IV , 

E £i/(sin r.) 



the equivalent virtual MIMO system, v = — ' , is both fairer in terms of energy-efficiency and has 



a more physical interpretation than w. 
Let us go back to the first drawback of w. To deal with it, |[56l introduced the concept of price of anarchy 
(PoA). The PoA was initially used to measure the inefficiency of equilibria in non-atomic selfish routing games, 
that is with a large number of players. In the context of games with a finite number of players, it is defined as 
follows. 

Definition 20 (Price of anarchy): The PoA of the game Q is equal to the ratio of the highest value of the 
social welfare (joint optimization ) to the worse NE of the game: 

maxopc w(s) 

PoA = V , (7) 

mm^.g^NE w{s*) 

where is set of Nash equilibria of the game. 

The price of stability (PoS) is defined similarly by replacing the denominator of the PoA with the best NE of the 
game, that is PoA and PoS coincide if there exists a unique NE. Interestingly, these quantities can be bounded 
in some cases. For instance, in the case of non-atomic routing games the PoA can be upper bounded by using 
variational inequalities. In a simple scenario where the cost functions of the players are affine functions this 
upper bound is | (see e.g., ifSTl ). 

B. Improving equilibrium efficiency 

When the performance of the network at the (considered) NE is found to be insufficient, the network or 
the game can be modified. There are many ways of doing this and we will just mention a few of them. What 
is important to have in mind is that the corresponding changes generally require allocating some resources 
(time-slots, band, ...) in order for the nodes to exchange some information and implement the new strategies. 

A possible way of improving the equilibrium efficiency is to transform the non-cooperative game/network into 
a cooperative game/network. Note that we distinguish between cooperative networks and cooperative games. In 
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a cooperative network, say a cooperative MAC where transmitters exchange cooperation signals |[58l . |[59ll . the 
transmitters can still be selfish. In a cooperative game, some players help each other. For instance, in a team 
game, the players have a common objective and they do not necessarily exchange some signals for this purpose. 
A team formulation of the PC game introduced in HI will however require full CSI at all the transmitters. 
Indeed, as mentioned in iHTI . if all the transmitters want to maximize w, every transmitter will need to know 
hi,..., hx, in contrast with the non-cooperative game where only hi is required at transmitter i. Of course, it 
is also possible and even required in a large network to form smaller groups of players: this is the principle of 
coalitional games (see e.g., ||60l . ||6T1 for coalitional games with and without transferable utility respectively). 
If each member of a group or coalition has enough information, the coalition can even form a virtual antenna 
|[62l and the gain brought by cooperation has to be shared between the players of the group. In such games, we 
see that we can have both locally cooperative networks and a non-cooperative game between the coalitions. In 
cooperative games, the counterpart of the NE solution concept for non-cooperative games is the Shapley value 
|[63l . Note that there are other forms of cooperation, sometimes more implicit. This is the case of repeated 
games (see e.g., |[64l for infinitely repeated games). Repeated games are a special case of dynamic games which 
consist in repeating at each step the same static game and the utilities results from averaging the static game 
utilities over time. In such a games, certain agreements between players on a common plan can be implemented, 
and a punishment policy can also be implemented to identify and punish the deviators. A simple wireless game 
where the concept of repeated games has been applied is the water-filling game by |[39l to the fast fading MAC 
with single-antenna transmitters and a multi-antenna receiver. The authors show that the capacity region frontier 
is reached by repeating the non-cooperative game where selfish users maximize their transmission rate. At last 
we will mention an other form of cooperation: bargaining. Very interestingly, Nash has proved that cooperative 
games ll60l can be studied with the same concepts as those used for non-cooperative games: a cooperative 
profile of strategies can be obtained as a subgame perfect equilibrium (which is an equilibrium having a certain 
robustness against changes in the main equilibrium plan, see ll65l for more details) resulting from a bargaining 
procedure between the players. An example of application of this concept is |[66l where two multi-antenna BSs 
cooperate by implementing a Nash bargaining solution. The bargaining solution has the advantage of being 
simple but for more than two players, this solution is rarely used because it does take into account the fact that 
an isolated group of players cooperating only with each other can be formed. 

The ways of improving the efficiency of the network equilibrium we have mentioned so far, are generally very 
demanding in terms of CSI at the transmitters and can possibly require to establish new physical links between 
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some nodes. Since cooperation can be costly in terms of additional resources, a more reasonable solution can be 
to merely coordinate the players. Here, we do not mean creating coordination games B6l . which corresponds to 
a certain type of games we will not study here, but adding a certain degree of coordination in a non-cooperative 
game. Coordination between users can be stimulated, for instance, by using existing broadcasting signals like 
DVB or FM signals (case of public information), or by introducing dedicated signals sent by a BS (which can 
send both private and public information). The fact that all players of the game have access to certain (public 
or/and private) signals generally modify the players' behaviors. This knowledge can lead to a more efficient 
equilibrium, which can be a new NE or even a correlated equilibrium |[T4l . The authors of |[67ll have shown 
that, in a MAC where a slotted ALOHA protocol is assumed, a public coordination signal induces correlated 
equilibria that are more efficient in terms of reducing the frequency of collisions between users. More generally, 
it can be shown |[T4l that the set of achievable equilibria is enlarged by using common and private messages 
in the context of correlated equilibria. At last we will just mention two other usual techniques to improve the 
performance of a network at the equilibrium: (1) implementing a pricing technique or (2) introducing a certain 
degree of hierarchy in the game. Technique (1) has been used by ||27l for energy-efficient PC games and by 
|[39]| for transmission rate-efficient PC games. Technique (2) has been used by PTI for energy-efficient PC 
games and by |[68l for transmission rate-efficient PA games. 

In this section we have mentioned several techniques to deal with equilibrium inefficiencies that are inherent 
to the non-cooperative game formulation. What is the best technique to be used? The answer to this question 
depends on many factors. Among the dominant factors we have the feasibility of the technique, predictability 
of the effective network state and of course the performance of the solution. Feasibility includes for example 
realistic information assumptions (CSI), complexity constraints at the terminals, problems of measurability. 
Predictability can be the impossibility to prove the uniqueness of the equilibrium. For example, implementing 
pricing necessitates to modify the original utility functions and uniqueness can be lost or not predictable after 
theses changes (see e.g., ll27l ). Performance can be a certain target in terms of quality of service. 

vn. Beyond Nash equilibria in strategic games with finite number of players 

In this article we have mainly focused on static/one-shot games with complete information and finite number 
of (rational) players. The methodology described in this article can be, to a large extent, re-used in other types 
of games having possibly different types of equilibrium. Taking into account the space constraints we had, the 
authors propose to briefly discuss two assumptions here: 1. The assumption on the number of players: What 
does the concept of NE become in games with a large number of players? An important concept of solution 
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to these games is Wardrop equilibrium 1691 ; 2. The static game assumption: What does the concept of NE 
become in dynamic games? 

A. Nash versus Wardrop in large games 

To establish the link and differences between the Nash and Wardrop equilibria in a concrete way, our 
discussion is built on specific but useful scenarios in wireless communications, the problem of packets routing 
in wireless networks and ad hoc wireless networks. 

Network games have been studied in the context of road traffic since the 1950s, when Wardrop proposed the 
following definition for a stable traffic flow on a transportation network: "The journey times on all the routes 
actually used are equal, and less than those which would be experienced by a single vehicle on any unused 
route" (see p. 345 of ||69l ). In fact, this definition of equilibrium is different from the one proposed by Nash. 
Expressing the NE in terms of network flows, one can say that a network flow pattern is an NE if no individual 
decision maker in the network can change to a less costly strategy or route. When the number of decision 
makers in the game is finite, an NE can be achieved without the costs of all used routes being equal, contrary 
to Wardrop equilibrium (WE) principle. The WE assumes therefore that the contribution to costs or delays 
by any individual user is zero. In other words, the population of users is considered infinite. In some cases, 
Wardrop principle represents a limiting case of the NE principle as the number of users becomes very large 
fTOl . Since routing in networks is also a fundamental part of communication networks, it was natural to expect 
the concepts of WE and of NE to appear in routing games. The natural analogy between packets in a network 
and cars on the road was not satisfactory for applying the Wardrop concept to networking, since packets, unlike 
cars, do not choose their routes. These are determined by the network routing protocols. Moreover, for a long 
time, routing issues did not concern wireless networking as it was restricted to the access part to a network 
where each terminal is associated with a given BS. 

Routing has become relevant to wireless networking when ad-hoc networks have been introduced, see e.g., the 
pioneering work by Gupta and Kumar iTTTI . Yet game theory has penetrated into ad-hoc networks in a completely 
unexpected way. Indeed, to our knowledge, it is in this framework that non-cooperative game theory appears 
for the first time as a basic powerful tool to solve problems that do not involve competition. In fTTI . Gupta and 
Kumar propose a routing algorithm for packets that should satisfy some properties: packets should be routed by 
the network so as to follow shortest paths. It is thus not the average delay in the network that is minimized; the 
design objectives are to find routing strategies that result in (i) equalizing delays of packets that have the same 
source and destination so as to avoid re-sequencing delays that are quite harmful for real time traffic as well as 
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for the TCP protocol for data transfers, and (ii) making these delays minimal, i.e., not to use routes that have 
delays larger than the minimal ones. The authors design a network routing protocol that achieves these two 
objectives. But these objectives are nothing else than the WE definition, a definition that arises in a completely 
non-competitive context. It is only ten years later that the WE penetrates into ad-hoc networks in a competitive 
game context. The problem of competitive routing in massively dense ad-hoc networks has been introduced in 
|[72l . The author observes that as the density of mobiles grow, shortest paths tends to converge to some curves 
that can be described using tools from geometrical optics in non-homogeneous media (see Fig. |3]l. Later, the 
electromagnetic field has been used to approximate the routes of packets in massively dense ad-hoc networks 
(see |[73l and references therein). Only later, in |[74ll[75l the natural concept of WE was introduced in massively 
dense ad-hoc networks as a natural tool that deals with the competitive interactions between mobiles. This is 
a special version of WE defined on a continuum limit of a network, whose links and nodes are so dense that 
they are replaced by a plain. 

B. Beyond static games 

We have already mentioned in Sec. |V] the important fact that Nash equilibria predicted in a static game with 
complete information can be the effectively observed outcome of a game (with partial information) played in 
several steps where each player observes the actions played by the others, react to them by playing his BR, the 
others update their strategies accordingly, and so on. This clearly establishes a first link between static games 
and multi-step games. It turns out that the static game analysis is also very important to study a certain class 
of dynamic games namely repeated games, which consists, in their standard formulation ||64l . in repeating the 
same game at every time instance. The players want to maximize their utility averaged over the whole game 
duration. Interestingly, equilibria in certain repeated games can be predicted from the analysis of the game 
played in one shot. An important result in infinitely repeated games is the folk theorem, which provides the set 
of possible Nash equilibria of the repeated game (see e.g., 11761 for more details). 

Another important class of games are evolutionary games |[T3l . A concept of solution for these games is 
the concept of equilibria evolutionary stable (EES). This concept generalizes the NE in the sense that these 
equilibria are stable to the deviation of a fraction of the whole population (this therefore represents a large 
number). Additionally, these types of games are less demanding in terms of rationality assumptions. 
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VIII. Conclusion 

Even in this short article, we have seen that game theory offers many strong results to prove existence of 
equilibria, select one of them when there are multiple equilibria and improve their efficiency. Note, however, that 
the current literature comprises not so many results to tackle the equilibrium uniqueness issue. In any case, all 
the provided results are based on certain assumptions in terms of information, rationality, and game stationarity. 
A real challenge for wireless games will be to be able to characterize equilibria under more realistic assumptions. 
For example, it is well known that CSI is always imperfect and that rationality can be an arguable assumption 
in heterogeneous wireless networks. And what about stationarity in wireless networks where channels can vary 
rapidly and the number of players can change? A real equilibrium theory specific to wireless networks will 
probably need to be built to address these issues. From the practical point of view, the learning approach in 
wireless networks opens a large avenue for technological innovation and designing algorithms implementable 
in real life wireless networks. 
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Apply 




Fig. 1. A (non-exhaustive) methodology for proving the existence of a pure Nash equilibrium in strategic games. The reader has to 
refer to the acronyms and references used in Sec. IIIII 
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Best Response Functions (p^=1, p^=3, p=2) 




«1 



Fig. 2. In two-band two-user interference relay channels, PA games have multiple NE 1361 . If the users plays and observe each other 
alternately, the game converges to an NE depending on the starting point of the game. 
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Fig. 3. Minimum cost routes in increasingly large networks. Optimal routes tend to follow to the Fermat principle for light propagation 
in non-homogeneous media. 
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